System and Method For Specifying and Applying Microarray Data Preparation 

This invention relates to systems and methods for analyzing data such as microarray 
data, and, more particularly, for specifying and applying a user-selected, user- 
variable sequence of mathematical data preparation operations (DPO's) to data, 
Microarray data is numerical information derived from a microarray experiment. A 
microarray is a collection of known genetic material such as nucleic acids, proteins, 
small molecules cells or other substances placed and immobiHzed on a subtrate such 
as a glass slide or siUca wafer. Such a microarray often appears as a microscopic, 
ordered array of such substances that enables parallel analysis of complex 
biochemical samples. A microarray experiment is an experiment done upon a 
microarray that produces microarray data. The invention includes a device for 
specifying multiple sources of related data (and their relationships) upon which the 
DPO's operate and some of the novel operations performed by some DPOs, such as 
non-linear normahzation of unequal channel effects in a multi-channel experiment. 

The systems include a computer readable medium comprising one or more 
DPO's that a user can load, select, sequence and then apply to the input data. These 
systems preferably include a computing device such as a personal computer or 
workstation. Upon application of the user-selected, user-sequenced DPO's to the 
input data, the results can immediately be displayed or stored in numerical terms. 

In a preferred embodiment, the computer-readable medium is a hard disc, 
CD-ROM, or other similar computer-readable medium such a medium being the 
CD-ROM containing the GeneSight software product from BioDiscovery, Lie, This 
product includes a computer-executable program comprising a software module, 
written in Java, with a user interface having a transformation toolbar, a sequence 
assembly area, and a plurality of user-selectable, user-sequenceable operations such 
as DPO's. 

In a preferred embodiment, the system includes a user interface display, for 
example, on a cathode-ray tube (CRT), comprising: a toolbar of DPO icons, a 
sequence assembly area into which a user drags and sequences, in user-selected 
order, a plurality of such icons, and a customized dialog box for each DPO a user 
selects. These dialog boxes prompt a user to choose from and enter one or more of 
the various parameters associated with a particular DPO. 
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Each DPO includes: 

1) An associated icon (a small version displayed in the toolbar and a larger 
version displayed in the sequence assembly area), 

2) Ability to drag a selected icon from the toolbar into a place within a 
sequence assembly area. Any restrictions regarding the location of where 
the DPO can be inserted will be enforced when dragged. For example, in 
some cases, one type of DPO can only be inserted before another type, 

3) An associated routine which performs a specific operation on the data at 
the desired stage in the processing pipeline. The DPO's operate on data 
one after another, in accordance with the user-selected sequence, each 
DPO modifying the data in a predefined way. 

4) An associated pop-up dialog box to prompt the user for data preparation 
parameters. 

These new systems include a memory that stores input data such as 
microarray data. Such microarray data may be in tabular form, in preferred 
embodiments. At a most fundamental level, the data table is a matrix of gene 
expression values. Each row corresponds to one gene or clone, and each column 
corresponds to one experimental condition, or vice versa. Therefore, each entry is 
the expression value of one gene or clone under one experimental condition. 

These expression values come from expression data sources. An expression 
data source is a source of numerical information, such as a file or database. A data 
source contains quantified microarray data, typically produced by an image analysis 
software, such as BioDiscovery's ImaGene product. 

The process of specifying data sources to use, and how to combine these 
sources in a preferred embodiment, appears, in a simple, intuitive way, in the "data 
set builder" module of the GeneSight software package. The "data set builder" is a 
software tool which groups and organizes the information from one or more data 
sources for analysis. The operation of the data set builder follows. The data set 
builder comprises four elements: 

1) The data source Ust: The list of available data sources that may be used in 
a data set. 
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2) The experiment/ control lists: Two lists of data sources taken from the 
data source list. These two lists represent data sources that may be 
combined in pairs. This allows DPO's that perform pairing, such as the 
ratio and difference DPO's, to be used on this data set. 

3) The replicate experiment list; A list of data sources, or pairs of data 
sources from the experiment/ control Hsts, that represent those that may 
be combined, such as with the Combine RepHcates DPO. This list 
represents experiments that have been repeated and have produced a 
number of experimental values for the same condition(s). 

4) The final data set: A list of either (1) single data sources, as from the data 
source Hst, (2) paired data sources, as from the experiment/ control lists, 
or (3) replicated data sources, as from the replicate experiment list. These 
data sources provide the experimental values used in this invention. 

This data set builder allows the incorporation of data sources that may not 
have precisely the same gene sets. The user has the option of taking the intersection 
or union of the gene sets in these types of data sources. 

Background correction, if included, is preferably first in the DPO sequence. 
Other DPO sequences might be more logical than their permutations, but the 
embodiment of the invention in GeneSight enforces no other constraints. The 
invention contemplates a general mechanism for specifying such constraints, and 
can therefore make any DPO force itself to precede any of a list of other types of 
DPO's, as needed. 

The transformation from quantified spot values to gene expression values 
may involve a number of different sequences of DPO's. A preferred embodiment 
includes the following exemplary set of possible DPO's: 

A) Background correction: Removes ambient background values from 
quantified spot values. The background value for each gene may come 
from the same or from a different expression data source. Usually, 
background correction is performed by subtraction. There are several 
variations: 

a. Local: Subtract from the spot intensity the immediate background 
around the spot. The "immediate background" is the average or 
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median of the brightness of the image pixels in the immediate vicinity 
of, but not including, the spot. 

b. Subgrid Median: A microarray image is a rectangular array of spots, 
which may be further segmented into subgrids, each of which is an 
uninterrupted rectangular array of spots. To apply this method, for 
each spot first determine the image subgrid containing it. Then take 
the median of the local background values for all spots within the 
subgrid, and subtract this median from the spot's sign^ intensity. This 
method is robust to contamination of the background intensity of a 
few spots within a subgrid, but assumes that the background intensity 
is consistent across the subgrid, so that the median is a good estimate of 
the background for each spot within the subgrid. 

c. Local Group Median: For each spot, this method subtracts the median 
of the background levels of the n x n square of nearby spots, where n is 
selectable by the user. This method provides an approach intermediate 
between the local background correction and the subgrid median 
background correction, useful in the case that there is isolated 
background contamination, but the true background intensity varies 
over the subgrid. Normally the n x n array of spots is truncated at the 
subgrid boundary. 

d. Median of Local Blank Spots: For each spot, from the set of 
neighboring spots indicated as "blank," this method subtracts the 
median of the intensities of the n nearest of such spots. The value 'n', 
is user-specified. This method helps when the spots are close together 
so that there is not much backgroimd intensity information. The 
emplaced "blank spots" provide surrogate background information. 

B) Omit Flagged Spots: Removes those expression values from the table that 
have been "flagged" as poor values or values of some particular interest. 
Flags are predefined labels associated with each spot value when the data 
sources are imported, for example, from the data set builder in 
GeneSight. 

C) Combine Replicates: Combines the quantified spot values for multiple 
spots representing the same gene or clone under the same experimental 
condition. The replicated spot values may come from the same or from 
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different expression data sources, or both. Expression values can be 
combined in a number of different ways. These include taking the 
median or mean of the values, and optionally omitting outHers. To omit 
outliers we calculate the standard deviation of each set of replicate values, 
ask the user to specify an outHer "threshold" in terms of the number of 
standard deviations from the mean beyond which a value is considered an 
outlier. Outliers are omitted from subsequent evaluation. 

D) Fill in missing values: Supplies values for those that have been removed 
using another DPO (i.e.. Omit Flagged Spots). The values inserted may 
be (1) user-specified, or (2) determined by the range of other values for 
the specific clone or for the experimental condition, such as average or 
median of the clone or condition. 

E) Floor: Sets those expression values that are below a specified threshold 
value to the threshold value. 

_ F) Log transform: Modifies all expression values to be the log of the values. 

S The base of the log and the offset can be specified by the user. 

J G) Ratio: Combines quantified spot values for two experimental conditions 

2 to yield expression values which are "relative", by computing, for 

^ instance, the ratio of experiment divided by control. Typically this 

P operation is used to combine the pairs of measurements for each spot in a 

single, two channel microarray. 
^ H) Difference: As an alternative to the "Ratio" DPO, this combines 

O quantified spot values for two experimental conditions to yield the 

ft difference between the values. This alternative would be employed if the 

p logarithm DPO has already been applied to the data. 

M> I) Omit low expression levels: Removes those values that are below a 

specified threshold value. This is used to remove from the data set 
measurements which have very low intensity and hence are not 
considered trustworthy. 
J) NormaHzation: Modifies the expression values to remove experimental 
artifacts associated with each experimental condition. The modification 
depends on the DPO's parameters. For example, it may consist of 
calculating the mean of each condition's values and dividing each value 
with a condition by the condition's mean. The following is a list of 
common normalization procedures: 

a. Divide by mean: The mean of all the intensity values for one 
channel of one microarray is calculated. All values within said 
channel are then divided by this mean. This corrects for linear 
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scaling effects from one array or channel to the next, 

b. Divide by percentile: As in (a) but the mean is replaced by the pth 
percentile, where p is chosen by the user. P =0.50 is equivalent to 
the population median, 

c. Subtract mean: Instead of dividing by the mean, as in (a), the mean 
is subtracted. This is useful in the case that the Log transform has 
been applied, transforming scaling effects into additive effects, since 
this normalization corrects for additive effects. 

d. Subtract Percentile: Instead of subtracting the mean, as in (c), the 
pth percentile (as specified by the user) is subtracted. 

e. 2-Score: This normalization procedure first subtracts the 
population mean, then divides by the population standard 
deviation, thus correcting for both additive and scaling effects, and 
transforming the data into the "number of standard deviations from 
the population mean." 

f . Linear Regression Normalization: This normalization procedure is 
applied to two-channel pairs (typically from one microarray), in 
order to shift and scale the data such that the mean squared distance 
of the points from the first diagonal is minimized. 

In addition to the above approaches, a unique non-linear normalization 
has been developed and implemented in the GeneSight software program 
and is part of the present invention. Commonly used normalization 
methods apply a single normalization factor (such as dividing by the 
mean or median, calculating the z-score, etc.) to all genes. However, in 
many instances, the needed normalization factor varies in a non-linear 
way with the intensity of the fluorescent emissions described below. To 
normalize such different values, our non-linear normalization method 
divides the intensity range into bins, or groups of neighboring values, and 
determines the normalization values separately for each bin in a 
computationally efficient way. 

The parameters for this method include the size of each bin, which 
can be a user-selected number, a value calculated by the method itself, or 
a constant. To avoid having too few genes in a given bin, leading to a 
potentially incorrect normalization value, a more adaptive approach 
increases bin width to ensure that a predetermined number of genes 
having intensity values fall within the bin's range. The method also 
makes sure that the correction applied in adjacent bins does not lead to. 
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large discontinuities of the normalized values. This can be done by 
imposing restrictions on the normalization parameters in adjacent bins, 
or by partially overlapping the bins. 

Consider {x^.x^ } the ordered values measured for one channel 
(e.g. control) and {yi,y2.'-yyn] corresponding ordered values measured 
for a second channel (e.g. experiment). The method divides the range of 
the first channel into n bins. Assume that the j-th bin is defined by the 
values Xj and Xj^^ . Assume that the corresponding measurements of the 
second channel are yj and yj^^ . For each bin, the method calculates the 
center of the x and y values falling in that bin. The center can be defined 
in several ways using means, medians or other center definitions using 
one of several distance measures (Euclidian, Mahalanobis, Ward's, squared 
Euclidian, Chebychev, etc.). Alternatively, the bins can be defined by 
choosing a center value x^, and by taking the boundaries of the bin as 
x^~Ax/2 and + Ax / 2 where Ax is a chosen bin size. The center value x^ 
can take values from {x^^,,,.,x^,^} where x^-^ is the largest Xj <x^ -Ax/2 
and x^^ is the smallest x^- > x^ + Ax/2 . 

For each bin defined in one of these ways, assume that the center 
of the X values in the bin is x. , the center of the y values in y. and the 
centers of the x values and y values in the neighboring bin are x-^^ and 
y^_^^^ respectively. In a preferred embodiment, for each value 
corresponding to a value x^ , where x- < Xj^ < x-^^ , we then calculate a 
normalized value j)^ as follows: 

yi.i-yi 

Other formulae may be applied at this stage in order to compensate for 
other types of non-linear effects unequal on the different channels. The 
normalization method does this in such a way that certain global 
properties such as continuity and differentiability are maintained. Such 
properties are ensured by posing explicit conditions or by overlapping 
the bins. 

By performing the said normalization on bins, our method is more 
computationally efficient than prior art inasmuch as it reduces the 
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number of operations necessary. 



The foregoing set is only an example of potential DPO's and their specific 
operations on the data. Many other operations on one or multiple sets of values are 
also feasible. Since the user might require different sets of the above operations to 
be applied in different sequences depending on the type of experiment, the present 
invention offers a simple, intuitive, and very flexible means to accomplish this task. 
In practice, there are sets of ordered DPO's that are typically used. In one such 
preferred embodiment, GeneSight, these are: 

Simple 

Local background correction 
Omit flagged spots 
Compute ratio 
Normalize 



Local background correction 
m Omit flagged spots 
P Normalize 

Compute ratio 

■A , 

O Log Scale 

Local background correction 
Q Omit flagged spots 
H Floor low values to 20.0 

Compute ratio 

Take Log (base 2) 

Normalize (subtract from each channel its mean) 

Lo g Scale/Replicates 

Local backgroimd correction 
Omit flagged spots 
Floor low values to 20.0 
Compute ratio 
Take Log (base 2) 

Normalize (subtract from each channel its mean) 
Combine replicate values 
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The program preferably outputs a table for display of transformed data, 
showing the effects of the DPO's, DPO's are applied in a sequence. Each DPO 
takes as input the data e.g. a data table, as modified by previous DPO(s), performs 
some operation, and places its results in the data table. The contents of the data 
table, after application of the DPO's, is sensitive to the order in which the DPO's 
are applied Thus, the system displays, and allows a user to control, the order in 
which the DPO's are applied to the data. 

The assembly area preferably displays the sequence by arranging the icons for 
the DPO's, left to right, with rightward arrows connecting them. Preferably, a 
button near (e.g., below) the sequence assembly area labeled "Apply Data 
Preparation" is enabled after any change is made to the sequence. When pressed, 
the DPO's are applied to the data or data table, in order. The system allows a user 
to control the order, via a "drag and drop" user interface. The user may drag a 
DPO icon from the toolbar into place in the sequence. The system then inserts the 
icon appropriately, connecting it to its predecessor and successor DPO's with 
rightward arrows. The user may rearrange the icons by dragging an icon from its 
position in the sequence to a new position. When the icon is positioned, the 
custom parameter dialog appears, prompting the user to select any needed data 
preparation parameters. Icons may be dragged out of the sequence assembly area, 
thereby deleting them from the chosen sequence. 

The system has the capability to broadcast software "events", i.e. messages 
indicating that the data preparation sequence has changed. Both data displays and 
various derived graphic plots are designed to "listen" for these events, and update 
their displayed information immediately. Thus, modifications to the DPO 
sequence by a user are propagated immediately to the derived displays providing 
useful interaction and feedback regarding the effects of the chosen numerical 
operations. 

The system preferably includes a menu of predefined sequences of DPO's, the 
ability to save (into a computer file or database) a user-defined sequence of DPO's, 
and the ability to re-load a user defined sequence. 

The methods of this invention comprise the steps of: selecting, sequencing 
and displaying a plurality of computer operations, in iconic form, in the graphical 
user interface of a computer processor, where each displayed icon represents and 
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invokes one or more of these operations; applying the resulting sequence of 
operations to input data that can be modified by these operations; and outputting, 
for display or storage, the resulting, modified data. The resulting data can be 
displayed numerically, in table form, or in graphical form. In preferred 
embodiments, the input data is microarray data, often in tabular form. The 
resulting, modified input microarray data, or resulting data, can be stored or 
displayed as numerical, tabular or graphical data. 

BRIEF DESCRIPTION OF THE DRAWINGS 

This invention can better be understood by reference to the drawings 
wherein Figure 1 illustrates schematically a preferred embodiment of the systems 
and methods of this invention; and Figure 2 results obtained using the new 
normalization methods of this invention. 



DETAILED DESCRIPTION OF THE DRAWINGS 

Figure 1 shows the system for applying a data preparation sequence (12) to a 
data table (15). The data comes from a set of data sources (10), is organized by a 
data set builder (11) into the data table (15). The data is transformed by the data 
preparation module (14). The processed data is then displayed by various 
spreadsheet views and graphs. 

Figure 2 shows the system for specifying a plurality of data preparation 
operations 25, 26, ... 27 in a user-selected, user-sequenced order to a table of raw 
data. The user selects, from some representation 20 of the available 
transformations, 21, 22,... 23, the data preparation operations he wishes to apply, 
drags and drops the icons representing the desired operations into assembly area 24, 
where they are sequenced left-to-right, and connected to one another with 
rightward-pointing arrows, indicating the sequence in which the operations are to 
be applied to the table of input data. After assembly and sequencing of the desired 
DPO's in assembly area 24, the user activates the apply button 28. The processor 
associated with the system then applies the DPO's displayed in area 24 in the 
displayed sequence. The resulting data is displayed table 29. 

A DPO unique to GeneSight is a non-linear normalization method that is 
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applicable to pairs of measurements, where a "measurement" is a number indicating 
a level of gene expression as determined by an empirical process. In a microarray, 
each spot corresponds to a particular gene or clone. Once a microarray slide is 
processed, or hybridized, two types of molecules will bind to each spot. The two 
can be thought of as healthy and diseased states of a cell, or as a control and an 
experimental value, and are differently "labeled." A label can be a fluorescent dye 
particle that emits light at a particular wavelength. Examples are the cy3 and cy5 
dyes that emit green and red colors, respectively. The system measures the relative 
intensity of these two emitted colors in two channels, and can plot the level of 
emission, or expression level, of a gene for each channel on a scatter plot. If a gene 
is present in the same amount in each state, and therefore in each channel, the levels 
of emission from each channel are about the same, and the points in a scatter plot of 
the two channels cluster around a line with slope of 1. If the levels in the two 
channels differ, the points in the scatter plot lie above or below this line. Due to 
various causes related to the laboratory procedures and materials, the levels of 
emission on different channels may be different even if the biological material is the 
same. Thus, normalizations techniques are necessary in order to compensate for 
these effects. 

Examplary results of the adaptive, non-linear normalization on some sample two- 
channel data are presented in Fig. 3. These plots represent the same biological 
material and should appear along a line with slope 1. The upper left panel shows the 
raw data which exhibits a displacement from the ideal line of slope 1 (most of the 
data is below the ideal line) as well as a non-linear distortion (the data is not 
straight). The upper right panel shows the data after the non-linear normalization 
was applied on 10 fixed bins. The data is shifted such that it is centered around the 
ideal line of slope 1 and also straight. The graph in this panel is plotted in the 
original range of the data for both axes. The lower right panel presents the same 
normalized data plotted in the ranges resulted after normalization. For comparison, 
the lower left panel presents the raw data in the same normalized ranges. 

Although in this example the non-linear normalization was used to bring the data 
to a line of slope 1, the same method can be applied to bring the data to any other 
desired shape as the biological interpretation might require. 
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Although the present invention has been described with reference to a 
preferred embodiment, those skilled in the relevant arts will see that many 
modifications and adaptations of this invention are possible without departure from 
the spirit and scope of the invention as claimed hereinafter. 
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